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SOME ASPECTS OF 
EXPOSURE-ACHTRVRMKNT RELATIONSHIPS 
IN FOLLOW THROUGH IN PHILADELPHIA 

This paper is a brief, limited report on exposure-achievement relation- 
ships in Follow Through in Philadelphia. It had been hoped to present a 
summary of more comprehensive analyses of these relationships, but a totally 
unforeseen series of delays in preparing the final, updated form of the 
individual pupil data file, the source of the analyses, barely allowed time 
for even the information reported below to be extracted. 

Follow Through in Philadelphia consists of seven models in 18 schools, 
with a total pupil population of approximately 6000 per year since the pro- 
gram became operational across the K-3 range. The seven models are: 1) 
Rank Street, 2) liehavior Analysis, 3) Bilingual, 4) EDC, 5) Florida 
Parent, 6) Parent Implemented, and 7) Philadelphia Process. 

The Follow Through individual pupil file was constructed in the summer 
of 1972 in conjunction with responding to a request from the Office of Education 
for pupil mobility data on the Follov^ Through population over the first four 
years of the program, 1968-1972. It had to be developed manually from the 
study of all available records yielding information on any pupil who had ever 
been in Follow Through in Philadelphia since the program's inception. The 
data was then transferred to computer cards formatted essentially according 
to the record type of the school district's pupil directory system of which 
the Follow Through file is a subsystem, dependent on the rej^ular updatings 
of the comprehensive pupil directory to provide current Follow Through 
pupil iuf ont\ation • 

The present file is on a computer tape with provision for a 300 character 



ERIC 



- 1 - 



record for nach pupil. Karh reconl contains the followinK Informntion: 
7--digit Philadelphia 1 H 
Name 

Birthdate 

School 

Grade 

Room No . 

Race 

Sex 

Follow Through Exposure Codes 

Head Start or Equivalent Experience Indicator 

1971- 72 Grade and City-wide test scores 

1972- 73 Grade and test scores from Stanford Research Institute (SRI) 
Provision for each succeeding year's test scores 

Follow Through exposure codes are two-digit indicators for each year; the 
first digit is a model code or non-'Pollow Through but Philadelphia school 
system code, or an out-of-system code; the second digit is a months of ex- 
posure index (5 months is accepted as a minimum requirement). City-wide 
test data are Intended to he the regular standardized achievement test in- 
formation included in the file. In the Spring of 1972, the city-wide battery 
consisted of: 1) the Stanford Early School Achievement Test in K, 2) the 
Metropolitan Achievement Test , Primary I in first grade, 3) the Metropolitan 
Achievement Test , Primary II in second grade, and 4) the Iowa Tests of Basic 
Skills , Form A, in third grade. City-wide testing was suspended in the Spring 
of 1973 due to the strike interruptions that school year, but Metropolitan 
Achievement Test (MAT) scores were provided by Stanford Research Institute (SRI) 
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for all four grades from the Spring test administration of the national 
Follow Through evaluation effort. 

The above mentioned delays in arriving at a final form of the file whlcli 
would be current through the Spring of 1973 revolved principally around: 
1) securing ID's for the approximately 1000 pupils for whom they were 
not available at the time of the original file construction, 2) manually 
updating most of the file for the 1972-73 school year because that year's 
dual strike period interfered with regular pupil directory updates, and 
more information than its two data points yielded was necessary for coding 
pup**.l Follow Through exposure, 3) manually searching out pupil ID's for 
approximately half of the SRI test records, where a name-birthdate matching 
program was unsuccessful in retrieving the ID from pupil directory files, 
and 4) subsequent problems in obtaining programming and computer time. 

The entire Follow Through pupil file contains information on 10,693 
pupils who are currently, or were at one time enrolled for at least five 
months in Follow Through in Philadelphia. The information below is based on 
the records of 2386 of those pupils, those who took the MAT in first grade in 
1972 and the MAT in second grade in 1973, and those who were administered the 
MAT. in second grade in 1972 and again in third grade in 1973. Only six of the 
seven models had two years of successive testing. 

Analysis of gain information is unfortunately not available for this 
report. What is presented below is a series of tables depicting comparisons 
of pupil performance on the MAT Total Reading score by grade between sets of 
exposure groupings in terms of the standard error of measurement of the dif- 
ference between means. 
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Exposure- Achievement Coi:wparisons 

Tables 1-4 offer four separate analyses of exposure-achievement relnt Ion- 
ships in the Follow Through program in F'hJ ladelphia. Comparisons are mncle by 
grade and year in grade between groups having maximum possible exposure for 
that grade with the group having one year less exposure, (Groups having still 
less exposure than one year below maximum have such small N's that comparisons 
were not considered justifiable.) The comparison methodology adopted was a 
two stage analysis, as found in Davis (Davis, F.B. Educational Measurements and 
Their Interpretation , Belmont, Calif,: Wadsworth Publishing Co., 1964). 
Initially, in Tables 1-4 exposure categories are compared In terms of the 
standard error of measurement of the difference between means to determine 
the significance of the difference between the obtained scores as estimates 

of true scores , using the formula: 

^^meas (X^- X2)= ^meas xy|N^+ 

(^meas X, the standard error of measurement of an obtained score of any in- 
dividual on the test was taken from the MAT manual; for Total Reading the 
figure is 1,8 for the MAT Primary I; 1,9 for MAT Primary II; and 2,5 for 
the MAT Elementary.) This stage is followed by a t-test to determine 
whether the difference between the means is only attributable to a. chance 
deviation from a^ true difference of zero in the particular groups tested . 
The T-test computation was derived from the formula: 

t = Xt- Xo 
n 1 2 

Smeas (X^- X2) 

where n = Nq^ + N2- 2. It was decided that this procedure was more directly 
useful for highlighting model differences than performing an analysis of variance. 



erJc 



- 4 - 



- g " 



to 

rH 

3 3 • 

A4 CO CO 

o d 

o 



CO 



CO (U 
M (U 



g*>4 <U 

0 PQ 
O <N 

t o 
c 

- > P 
W O M-l 

x: o 
u 

4J 



CO 

u 

1^ 



u 

a. 

w o 







M 






o 


M 


u 


M 




00 


M 




o 


W 




M 








^3 


P4 










(d 


H 


o 


a 






CO 




cd 


4J 




0) 


w 






a 




0) 










1 




td 














0 




a 




(d 








> 




o 


(d 


OJ 









ERIC 



4J 



CO 
Cd 

0 



to 



IX 

I 

Itxf 



O 



H 
O 





00 


CO 










iH 


o 


VO 






m 






O 




00 


00 





m 
o 
00 





C7^ 


vD 




CV4 




iH 


m 








n 


r-t 




m 









I 



w 
cd 



C/3 

W Q < 
Q 55 H 



vO 




CNi 


CO 






ON 


<f 


CM 


in 


to 




a\ 


00 


CM 


CM 


eg 


H 


CO 


<N 


CO 


CO 


uo 


ro 



vO 



ro 



VP 


O 




CO 


m 




CO 


00 






00 


00 


ON 


CO 


• 
















d 


VO 


<r 






r>» 


CO 




CO 




co 


CO 


CO 



CO 



CO 



00 



CO m 
in o 







00 




ro 


00 


\o 


CO 


iH 


CO 


in 




0 












CO 


<3- 


CO 


Oi 


eg 




CO 


ro 


CO 


CO 


ro 


CO 


o 


CO 




iH 


in 




CO 


tn 


in 


uo 


H 


<• 



CO 



in 



CO 

vO 



CO 
ro 



cvj 



B 
<d 

cd tc 

AJ O 
O V4 



- 9 - 



CO 


0) 






H 






1 


•H 


a 


• 


u 


O. 


CO 


CO 


Q) 




o 


C 


Cu 




dx 


CO 


1 




w 




H 


o 




C 


0) 


a 


CO 




o 




0) 


4J 


(0 


n3 


:i 








4J 


4J 


1^ 




0) 


CO 


cd 




PQ 




a. CO 






0 




0) 


a 


o 


1 


O 




u 




a 


a 






0) 


•H 






M 








OJ 


•H 



CSJ 



CO 



ERIC 























4J 






H 


H 


CO 


C/D 


H 


in 


iH 








O 


o 




IS 


O 


o 


O 




























</ 


V 






V 


V 
























CM 




















IX 

1 




















H 




































































rH 


CN 


CO 


in 




ON 


CO 






m 


ro 


<J' 


o 


o 




o 


cd 






m 




vO 


VD 


o 


VD 


iH 








cn 


CO 


CT\ 






O 


<J- 


B 


































H 


iH 




cn 




















00 








































• 

CM 




















CM 


















IXJ 


























CM 




CN 


m 


O 


CM 


CO 


1 






CM 




VO 


o 


CX) 




u> 


iH 




m 








rH 




r-^ 






















/-> 




















CM 


















\X 




















1 




C30 


CX) 






H 




CO 










VD 


CO 


CM 




CO 


a\ 








C30 


CM 






in 


iH 


in 










CO 


CO 


CO 


VO 


<3- 


H 


CO 


















• 


cd 




























































CO 




















CO 






in 


ro 


in 




in 


CM 


iH 


u 






CM 


CO 


<N 


in 


rn 


CO 


CM 


cd 


























vO 




vC 




CO 




VO 




IX 




<3- 


<r 




<!■ 


>d- 






on 

o 




















' 




















CM 




f-H 


in 


o 


VO 




<!• 


iH 










vO 


CM 


m 




CO 




iH 










iH 












(0 






rn 


VD 


CO 


VD 


in 


O 


CO 


)-< 






o 


ro 


vO 


<J- 


in 


<r 


vO 


cd 




CM 














• 




IX 




rH 


vO 


to 




rH 


VD 














<r 


<f 


<3' 


























CM W 




















O 




















' 






o\ 




CO 


f-H 


iH 


o 


vO 








ro 




<t 




iH 


CO 


iH 


iH 


















CNJ 


cn 










































!^ 


o 














<d 60 


"i 


H 


s 


iH 


CM 


CO 




in 




u o 




O 
















o u 




H 


Oh 

















- L - 



(0 0) 

o is: 



0) 0) 
0) 0) M 



0) 



T3 * 



U 0) MH 



H Pd w 



CO 
H 



erJc 



eg 



0) 



00 

in 



IX 
I 

IX~ 



IX 



IX 



0) 
CO 
0) 



0) 
M 

rn CO 
o 



3JX 



I 



H 
O 


H 
O 


H 


m 
o 


m 
o 


H 
O 


• 

V 


V 


s> 


V 


V 


V 





























00 




o 


00 


ro 


rH 






00 




rH 




rH 




00 




m 


iH 








rH 



o 
o 



rH 


<r 


est 




0^ 




o 


vO 


p^ 




00 




cn 




rH 


Cn4 


rH 




rH 




rH 



00 




CO 




rO 


00 


00 


rH 




VD 


ro 


00 


00 


o 


<t 


o 


<t 


in 






in 




CO 


rn 


rn 


in 




rH 







o 


rn 


00 


00 


vjD 


rn 


•<t 


VO 


o^ 


<!■ 


vO 


o 


m 


m 


<r 


VO 










<■ 





O 

VO 



00 



in 



in 



00 


CO 


CS4 


0\ 


ON 




00 


o 


VO 


O 




so 


rH 


CO 


tn 






<t 


CO 


eg 


tn 






-4- 











vO 



in 



O 

V 



0^ 
00 



00 



in 



00 



rH M 

*J o 
o u 



- 8 - 



0) 

a 

u 

W S (U ^ 
C 4J 



0) 

CO M 
•H C/3 W 

a* o 



o 

0) (U 

a M (u 

O CO > 

CO (U 4J 

•H >-< 
M 

CO <r 
o 



0) 



(U 



3 
O 
M 



0) 
0) 



oj El 

C CO 

r-H <(J o 

60 0) -U CO 

C CO yH 

•H O M-l 

M x: o 

04 4-> 



(U 
M 

CO 

o 

(U 
M 

O 



0) 



4J M 
C O 

oj a 



CO m 
<u o 



<0 
a 



M 
O 

a 

M 'd to 

^ 0) 



0 CO 



CO a xi 



CO (U (d C 



•H p. 
H W O 



>^ <d o 

M M }-i 
CO 60 )-i 
WOW 

Qj PL, t:> 
0 M 

a 

CO 03 
M 



^ CT3 

O 4J 

c o 

0) 



P4 

o 

M 

60 



g (0 <u 
B 



CO (U 



M 

13 
CO 

o 
a 



60 



CO 

a 

M >H M 

^ m ^ C ^ 

Q) *M •H 60 

CO <H 
O 



I U<4 0) 

(0 <D 



eg a > 

60 M n3 »-H 

H CJ QJ C 

CO H 'H - 

> a - 

(0 a * <u ^ 



4J 

o 



CO 



CO 



a *J 



ERIC 



CO 

CO 
cu 
6 



00 



ix: 
I 



J 

\^ 

CO 

CO 

00 



CO 
M 
CO 
(U 



CO 

1^ 

CO 

CU w 

^ B 
cn CO 
o 

' ^ 

CN 



CM 



CN 

12: 




O 



O 



CO 



o o 
V V 



O 

V 



00 
CO 


CN 

o 


.262* 


00 
VO 
ro 


.0238 










H 


CN 





O 


oo 


in 


m 


sr 


O 


O 








CN 




00 






CN 




CN 


VO 


iH 


CN 



i-H rO CTi 
i-H CN 00 

m sr 



o 
cn 
in 



<r 00 
<r 00 

00 vO 



o 

V 



vD 

in 





o 


CO 


H 


00 


C3^ 


C^ 


CN 


m 


oo 


O 




O 


on 


O 






OX 




CN 


H 


m 












m 



CN 
VD 



VO 

m 



00 
VO 



CO 



00 
VO 





csi 


CO 


VO 






00 


CO 


O 


CO 




H 


00 


VO 




CN 


O 


\o 


iH 


CO 


00 




in 


m 











CN 



CM 



ON 

cn 



ON 



o> 



cn 



Csl 



H M 

CO e>o 

4J O 

O M 



Regarding the t-test omploved, since local livaluatlon of Fol low Through 
in Philadelphia Eocuses on the Follow Through population in the city as the 
population of concern it was Celt that this was the more appropriate test 
rather than one allowing inferences to a larger national population, which 
seem best left to the national evaluation analysis. 

Table 1 compares first grade performance in the Spring of 1972 between 
maximum exposure and one-year-less-than maximum groups. The higher exposure 
group in each model and the total program is consistently higher in mean 
score with indications of significant differences in obtained score as well 
as significant mean differences for this population. 

In Table 2, where comparisons are made between maximum and one-year- 
less exposure groups among second graders in the Spring of 1972, higher ex- 
posure in models 3, 4, and 7 produces considerably less than significant 
differences at the one-pr-r-cent level in obtained score, and higher exposure 
in models 3 and 4 likewise does not approach acceptable levels of significance 
on the t-test. 

Second graders in the Spring of 1973 (table 3) , essentially those who were 
first graders in the Spring of 1972 (table 1), when separated into maximum and 
one-year-less exposure categories, show significant mean differences for the 
higher exposure group in this population in each model and the total program, 
except in model 3. Also note that higher exposure in models 4 and 5 does not 
correspond to differences in obtained score at the one~per-cent level. In 
model 3 the lower exposure group is significantly higher than the higher ex- 
posure group on both counts. 

Table 4 shows similar comparisons for third graders in the Spring of 1973 
(essentially those same pupils shown as second graders in the Spring of 1972 
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in table 2). With the exception of models 3 and 7, each model and the total 
program show significant differences in obtained score and significant pop- 
ulation mean differences (this population) favorinf> the hiRtier exposure jiroup . 
In model 3 the difference in obtained srore Is not significant at the one-per- 
cent level nor is there an indication at an acceptable level of significance 
of mean differences in this population, Tn model 7 both levels of significance 
favor the lower exposure group. 

Within the context of this analysis there seem to be consistent positive 
relationships between exposure and achievement in reading in models 1, 2, and 
the total program. The other models are inconsistent in this respect; model 5 
is less inconsistent than these others; model 3 is the least consistent. These 
findings correspond to the higher level of performance in models 1 and 2 which 
was apparent in cross-sectional analysis of Follow Through-Non Follow Through 
achievement in Philadelphia on the Spring, 1973 MAT administration. 

Table 5 is introduced to further illust-rate the performance level of model 2 
on the dimension of positive exposure-achievement relationship. As can be seen 
in tables 1-4, this model alone is consistently higher in mean performance than 
the total program in the maximum groupings, Davis' (ibid,) procedure for comparing 
mean performance of two overlapping groups was applied to determine whether there 
was a significant difference in obtained score favoring the model 2 group over 
the total program. The data in table 5 confirm that this was the case. The 
formula used was: 



One further indicator of model 2^s performance level is illustrated by the 
following data from a different perspective, that of changes in percentages of 
pupils scoring below the 16th percentile and above the 50th percentile. 
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on national norms as n funrtlon of exposure. Second graders in this modol wlio 
had I ^ - 2 years of exposure in the Sprinjj; of 1973 had 42% below the 16l)i and 
36% above the 50th percentile in Total Reading on the MAT; those who had 2^-3 years 
exposure, on the other hand, had 21% below the 16th and 48% above the 50th per-- 
centile. Somewhat similar changes favoring higher exposure are found in third 
grade performance in this model on the MAT Total Reading Test for the same 
Spring administration. Those with 2i$-3 years exposure had 30% below the 16th 
and 17% above the 50th; those with 3^^-4 years showed 25% below the 16th and 31.5% 
above the 50th percentile. 

Concluding Statement 

While these data and analyses are limited in their scope, there does seem 
to be preliminary evidence of positive exposure-achievement relationships in 
at least two models, and in the program as a whole, in Follow Through in 
Philadelphia. This relationship seems most pronounced in one of the models, 
model 2. 
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